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© Coded modulation with unequal levels of 



error protection. 



© Digital signals, such as digitized television sig- 
nals, are subjected to a source coding step in which 
a class of "most important" data elements repre- 
sents a proportionately greater amount of the in- 
formation to be communicated than the rest of the 
data elements. This is fallowed by a constellation 

FIG. 1 



mapping step which is carried out in such a way that 
those data elements have a lower probability of 
being erroneously detected at the receiver than the 
others. The constellation mapping step uses coded 
modulation In order to provide enhanced noise im- 
munity for the "most important" data element class. 
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Background of the Invention 

The present Invention relates to the transmis- 
sion of digital data, particularly the transmission of 
digital data which represents video signals. 5 

It is generally acknowledged that some form of 
digital transmission will be required for the next 
generation of television technology, conventionally 
referred to as high definition television, or HDTV. 
This requirement is due mostly to the fact that 10 
much more powerful video compression schemes 
can be implemented with digital signal processing . 
than with analog signal processing. However, there 
has been some concern about getting committed 
to an all-digital transmission system because of the T6 
potential sensitivity of digital transmission to small 
variations in signal-to-noise ratio, or SNR, at the 
various receiving locations. 

This phenomenon-sometimes referred to as 
the "threshold effect "-can be illustrated by consld- 20 
ering the case of two television receivers that are 
respectively located at 50 and 63 miles from a 
television broadcast station. Since the power of the 
broadcast signal varies roughly as the inverse 
square of the distance. It is easily verified that the as 
difference in the amount of signal power received 
by the television receivers Is about 2 dB. Assume, 
now, that a digital transmission scheme is used 
and that transmission to the receiver that is 50 
miles distant exhibits a btt-error rate of 10~ fi . If the so 
Z dB of additional signal loss for the other TV set 
translates into a 2 dB decrease of the SNR at the 
input of the receiver, then this receiver will operate 
with a bit-error rate of about 10~*. With these kinds 
of bit-error rates, the TV set that is 50 miles away as 
would have a very good reception, whereas recep- 
tion for the other TV set would probably be very 
poor. This kind of quick degradation in perfor- 
mance over short distances Is generally not consid- 
ered acceptable by the broadcasting Industry. (By 40 
comparison, the degradation in performance for 
presently used analog TV transmission schemes Is 
much more graceful.) 

There is thus required a digital transmission 
scheme adaptable for use in television applications 45 
which overcomes this problem. Solutions used in 
other digital transmission environments-such as 
the use of a) regenerative repeaters In cable-based 
transmission systems or b) fall-back data rates or 
conditioned telephone lines in voiceband data so. 
applications-are clear/y Inapplicable to the free- 
space broadcast environment of television. 

An advantageous technique for overcoming the 
shortcomings of standard digital transmission for 
over-the-air broadcasting of digital TV signals- 56 
-developed by employees of the assignee hereof- 
•comprises a particular type of source coding step 
followed by a particular type of channel mapping 



step. More specifically, the source coding step 
causes the television signal to be represented by 
two or more data streams while, in the channel 
mapping step, the mapping Is such that the data 
elements of the various data streams have differing 
probabilities of being erroneously detected at the 
receiver. Illustratively, a first one of the aforemen- 
tioned data streams carries components of the 
overall television signal which are regarded as the 
most ImportanMor example, the audio, the framing 
information, and the vital portions of the video 
InfOrmation-and that data stream Is mapped such 
that its data elements have the lowest probability of 
error. A second one of the data streams carries 
components of the overall television signal which 
are regarded as less important then those of the 
first data stream and that data stream Is mapped 
such that Its data elements have a probability of 
error that Is not as low as those of the first data 
stream, tn general, It Is possible to represent the 
overall television signal with any number of data 
streams, each carrying components of varying Im- 
portance and each having a respective probability 
of error. This approach allows a graceful degrada- 
tion in reception quality at the TV set location 
because, as the bit error rate at the receiver begins 
to increase with increasing distance from the 
broadcast transmitter, it will be the bits that repre- 
sent proportionately less of the TV signal informa- 
tion that will be the first to be bo affected. 

Summary of the Invention > 

In accordance, with the prose/rl Invention, I 
have devised a scheme which implements the 
above-doscribed overall concept of providing dif- 
ferent levels of error protection for different classes 
of data elements generated by the source encod- 
ing step-but which provides enhanced noise im- 
munity via the use of coded modulation, such as 
trellis-coded modulation. 

In preferred embodiments of the invention. In 
particular, the symbols in a predetermined 2N- 
dimenslonal channel symbol constellation. N 1, 
are divided into groups, each of which Is referred 
to herein as a "supersymbol." During each of a 
succession of symbol Intervals, a predetermined 
number of the most Important data elements are 
channel encoded, and the resulting channel coded 
data elements identify a particular one of the 
supersymbols. The remaining data elements, which 
may also be channel encoded, are- used to select 
for transmission a particular symbor from the iden- 
tified supersymbol. 

The approach as thus far described is similar 
In a general way to conventional coded modulation 
schemes in that the latter also divide the channel 
symbols into groups, typically referred to as 
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"subsets." However, the prior art subsets are 
formed under the constraint that the minimum Eu- 
clidean distance (hereinafter referred to as the 
"minimum distance") ^between the symbols in a 
subset is greater than the minimum distance be- 
tween the symbols in the constellation as a whole. 
In accordance with the present invention, however, 
the minimum distance between the symbols of a 
supersymbol is the same as the minimum distance 
between the symbols in the constellation as a 
whole, it is this distance property which allows for 
greater amount of noise Immunity for the most 
important data elements than for the other data 
elements, that immunity being optimized by keep- 
ing the minimum distance between supersymbols 
as large as possible-usuaJly greater than the mini- 
mum distance of the constellation. Specifically, 
once tho supersymbols are defined, it is possible 
to design codes for the most important data ele- 
ments based on the distances between the super- 
symbols. i.e., as though each supersymbol were a 
conventional symbol in a conventional constellation. 
This being so, a particular degree of noise immu- 
nity can be achieved for the most important data 
elements that is greater than what can be achieved 
for the other data elements. 

indeed, a tradeoff is Involved in that those 
other data elements suffer a coding loss, i.e., a 
somewhat lessened noise Immunity. Importantly, 
however, the coding gain that can be achieved for 
the most Important data elements is greater than 
that which can be achieved using conventional 
coded modulation schemes. 

Brief Description of the Drawing 

in the drawing, 

FIG. 1 is a block diagram of a transmitter em- 
bodying the principles of the invention; 
FIG. 2 is a block diagram of a receiver for 
transmitted signals transmitted by the transmit- 
ter of FIG. 1; 

FIG. 3 depicts a prior art signal constellation; 
FIG. 4 depicts a signal constellation Illustratively 
used by the transmitter of FIG. 1; 
FIG. 5 shows a bit assignment scheme for the 
constellation of FIG. 4; 

FIG. 6 shows a type of trellis encoder that can 
be used in the transmitter of FIG. 1; 
F'G. 7 is a table comparing the performance of 
the various illustrative embodiments of the in- 
vention disclosed herein; 
F/G. 8 depicts an alternative signal constellation 
that can be used in the transmitter of FIG. 1; 
FIGS. 9-11, when taken together, show another 
type of trellis encoder that can be used in the 
transmitter oil FIG. 1; 



RG. 12 depicts yet another signal constellation 
that can be used in the transmitter of FIG. 1; 
FIG. 13 shows another type of trellis encoder 
than can be used in the transmitter of FIG. 1; 
s FIG. 14 depicts yet another signal constellation 
that can be used In the transmitter of RG. 1; 
and 

FIG. 15 shows how a bit interleaver can be 
added to one of the channel encoders in the 
ro transmitter of FIG. 1 to provide enhanced im- 
pulse noise Immunity. 

Detailed Description 

is Before proceeding with a description of the 
illustrative embodiments, it should be noted that 
the various digital signaling concepts described 
herein-wlth the exception, of course, of the inven- 
tive concept itself-are all well known in, for exam- 

so pie, the digital radio and voiceband data transmis- 
sion (modem) arts and thus need not be described 
in detail herein. These include such concepts as 
multidimensional signaling using 2N-dimensional 
channel symbol constellations, where N is some 

26 integer; trellis coding; scrambling; passband shap- 
ing; equalization; Viterbi, or maximum-likelihood, 
decoding; etc. These concepts are described in 
such U.S. patents as U.S. 3,810,021, Issued May 7, 
1974 to I. Kalet et al.; U.S. 4,015,222, issued March 

so 29, 1977 to J. Werner; U.S. 4,170,764. Issued Oc- 
tober 9, 1979 to J. SaJz et al.; U.S. 4,247,940, 
issued January 27. 1981 to K. H. Mueller et al.; 
U.S. 4,304,962, issued December 8, 1981 to R D. 
Fracassi et al; U.S. 4,467,004, issued June 26, 

ss 1984 to A. Gersho et ai.; U.S. 4,489.418, issued 
December 18, 1984 to J. E. Mazo; U.S. 4,520,490, 
issued May 28, 1985 to L Wei; and U.S. 4.597,090, 
issued June 24. 1986 to G. D. Forney, Jr.-all of 
which are hereby incorporated by reference. 

40 Turning now to FIG. 1. video signal source 101 
generates an analog video signal representing pic- 
ture Information or "intelligence 0 which signal is 
. passed on to source encoder 104. The latter gen- 
erates a digital signal in which at least one subset 

46 of the data elements represents a portion of the 
. Information, or intelligence, that Is more Important 
than the portion of the Information, or intelligence, 
represented by the rest of the data elements. Illus- 
tratively, each data element is a data bit, with m + k 

eo information bits being generated for each of a 
succession of symbol intervals. The symbol inter- 
vals are comprised of N signalling Intervals, where 
2N is the number of dimensions of the constellation 
(as described below). The signaling intervals have 
w duration of T seconds and, accordingly, tho symbol 
intervals each have a duration of NT seconds. In 
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embodiments using two-dimensional constellations, 
i.e., N e 1, then of course the signaling intervals 
and the symbol Intervals are the same. 

Of the aforementioned m+k information bits, 
the bits within the stream of m bits per symbol s 
interval, appearing on lead 105, are more Important 
than the bits within the stream of k bits per symbol 
interval, appearing on lead 106. Two examples of 
how ono might generate a television signal of this 
type are given hereinbelow. jo 

The bits on leads 105 and 108 are indepen- 
dently scrambled In scramblers 110 and 111, which 
respectively output m and k parallel bits on leads 
112 and 113. (Scrambling is customarily carried 
out on a serial bit stream. Thus although not explic- 19 
itly shown in FIG. 1. scramblers 110 and 111 may 
be assumed to perform a parallel-to-serial conver- 
sion on their respective input bits prior to scram- 
bling and a serial-to-parallel conversion at their 
outputs.) In accordance with the invention, as de- 20 
scribed more fully hereinbelow. the respective 
groups of bits on leads 112 and 113 are extended 
to channel encodens-lllustratlvely trellis encoders- 
-114 and 115 which generate, for each symbol 
interval, respective expanded groups of the ex- 25 
panded r and p bits on leads 1 21 and 122, where r 
> m and p > k. The values of those bits jointly 
Identify a particular channel symbol of a predeter- 
mined constellation of channel symbols (such 8s 
the constellation of FIG. 4 as described In detail 30 
hereinbelow). Complex plane coordinates of the 
identified channel symbol are output by constella- 
tion mapper 131, illustratively realized as a lookup 
table or as a straightforward combination of logic 
elements. Conventional passband shaping and tele- os 
vision modulation are then performed by passband 
shapcr 141 and television modulator 151, respec- 
tively. The resultant analog signal is then broadcast 
via antenna 152 over a communication channel, in 
this case a free-space channel. <o 

In order to understand the theoretical underpin- 
nings' of the invention, It will be useful at this point 
to digress to a consideration of FIG. 3. The latter 
depicts a standard two-dimensional data transmis- 
sion constellation of the type conventionally used in 45 
digital radio and voiceband data transmission sys- 
tems. In this standard scheme-conventionally re- 
ferred to as quadrature-amplitude modulation 
(QAM)— data words each comprised of four informa- 
tion bits are each mapped Into one of 16 possible eo 
two-dimensional channel symbols. Each channel 
symbol has an In-phase. or I, coordinate on the 
horizontaJ axis and has a quadrature-phase, or Q, 
coordinate on the vertical axis. Note that on each 
axis, the channel symbol coordinates are * 1 or ± 3 ss 
so that the distance between each symbol and 
each of the symbols that are horizontally or verti- 
cally adjacent to It is the same for all symbols-that 



distance being "2". As a result ^of this uniform 
spacing, essentially the same amount ot noise Im- 
munity Is provided for all four information bits. 

As is well known, It is possible to provide 
Improved noise immunity without sacrificing band- 
width efficiency (information bits per signaling inter- 
val) using a coded modulation approach in which 
an "expanded" two-dfmensional constellation hav- 
ing more than (in this example) 18 symbols is used 
in conjunction with a trellis or other channel code. 
For example, my above-cited '480 patent discloses 
the use of a 32-symbol, two-dimensional constella- 
tion together with an 8-state trellis code. That cod- 
ed modulation scheme achieves approximately 4 
dB of enhanced noise immunity over the uncoded 
case of FIG. 3, while still providing for the transmis- 
sion of four Information bits per signaling interval. 
Here, too, however, essentially the same amount of 
noise Immunity Is provided for all four Information 
bits. 

In accordance with the invention, the known 
noise Immunity and bandwidth efficiency advan- 
tages of coded modulation are achieved while pro- 
viding different levels of error protection to different 
classes of bits. Specifically, I have discovered -that 
it is possible to achieve a level of error protection 
for a class of "most Important" bits which is sub- 
stantially greater than what can be achieved with 
the aforementioned conventional coded modulation 
approach. Indeed, the transmitter of FIG. 1 em- 
bodies the Inventive concept, as will now be de- 
scribed in further detail. , 

The constellation used In the transmitter of 
FIG. 1 Is Illustratively the two-dimensional 64-sym- 
bol constellation shown in FIG. 4 (each symbol Is 
represented as a dot in the figure). In accordance 
with the Invention, the symbols In the signal con- 
stellation are divided into groups which I refer to as 
"supersymbols." Specifically, the constellation of 
FIG. 4 Is divided Into 2' = 2 5 = 8 supersymbols. 
Four of the supersymbols, labeled 000.011. 100 
and 111, are each comprised of-jeight contiguous 
channel symbols assigned to that supersymbol. 
The other four supersymbols, labeled 001, 010, 
101 and 110, are each comprised of two non- 
contiguous groups, each comprised of four contig- 
uous channel symbols. (The use of such two-group 
supersymbols allows the overall constellation to 
have, for example, better slgnal-to-noise ratio, low- 
er peak-to-average power ratio and better sym- 
metry than would otherwise be possible.) 

In this example, m = k - 2. That is. 50% of 
the bits are In the class of mos\ Important bits. 
Each of encoders 114 and 115 adds one redundant 
bit, so that r » p - 3. The r = 3 bits on lead 121 
Identify one of the dght supersymbols and the p = 
3 symbols on lead 122 select a particular one of 
the eight channel symbols within the Identified 
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supersymbol. In accordance with an important as- 
pect of the invention, the minimum distance be- 
tween the symbols of a supersymbol-that distance 
being denoted cfc-isjthe same as the minimum 
distance between the symbols In the constellation 
as a whole. Indeed, it can be verified by observa- 
tion that this criterion is satisfied in RG. 4. Given 
this characteristic, increased noise immunity for the 
most important bits can be provided via appro- 
priate selection of a) the codes implemented by 
encoders m and 115 and b) the ratio a 
\t<h -where d, is the minimum distance between 
the supersymbols. (The parameter 4 is given by 
the minimum of the distances between all the pairs 
of supersymbols. In turn, the distance between any 
par of supersymbols Is the minimum distance be- 
tween any symbol of one of the pair of supersym- 
bols and any symbol of the other.) 

Specifically, a coded modulation scheme can 
now bo constructed for the most important bits as 
though the eight supersymbols were eight conven- 
tional symbols In a conventional constellation. (It is 
true that in a conventional constellation a symbol 
cannot bo divided into halves, as Is the case for 
supersymbols 001. 010, 101 and 110. However, for 
the purpose of coding design, one may treat each 
of the halved supersymbols as being located in 
only one of its two positions.) To design such a 
coded modulation scheme, the eight supersymbols 
are partitioned, as is conventional, into a predeter- 
mined number of subsets and an appropriate code 
is used to encode some of the most Important 
input bits to generate a stream of coded output bits 
which define a sequence of subsets. The remaining 
most Important input bits are then used to select a 
supersymbol from each Identified subset. In this 
particular example, each subset contains only a 
single supersymbol, i.e., there are eight subsets, 
and all most important input bits-Le, the two bits 
on lead H2-are encoded. Thus the Identification or 
a particular subset also identifies a particular super- 
symbol. It is from this particular supersymbol that 
the symbol that is ultimately to be transmitted will 
be selected as a function of the other, or less 
important, bits. 

Importantly, It will be appreciated that this ap- 
proach achieves-by virtue of the partitioning and 
code selected-a particular degree of noise immu- 
nity for the most important data elements that is 
greater than what can be achieved for the less 
important data elements and. Indeed, is greater 
than what can be achieved with conventional coded 
modulation, all other things being equal. 

As noted above, the less important bits, on 
lead 1 13, are then used to select a particular sym- 
bol from the identified supersymbol for transmis- 
sion. In profened embodiments, this selection also 
involves the use of coded modulation wherein at 



least some of the less important bits are encoded 
to identify a particular subset of symbols within a 
supersymbol and. If the subset contains more than 
one symbol, any remaining bits are used to select 
5 a particular one of those symbols. (The arrange- 
ment of the symbols within a supersymbol should, 
of course, be chosen jointly with encoder 115 to 
maximize its coding gain.) Again In this example, 
there are eight subsets of symbols within each 
jo supersymbol, i.e., one symbol per subset and both 
of the less Important bits on lead 113 are encoded. 
Thus the three coded bits on lead 122 identify, at 
one and the same time, both a subset and a 
specific symbol from the earlier identified super- 
75 symbol. 

A particular illustrative embodiment .for both 
encoders 114 and 115 Is shown In FIG. 6. (In this 
RG., the boxes labelled T" are T-second delay 
elements, the circles labelled * + " are exclus'rve-or 
zo gates, and the two-Input gates are AND gates, one 
of which has one of its inputs Inverted.) As noted 
above, the 3-bit output of encoder 114 identifies a 
particular supersymbol. Specifically, the bit values 
"110" output by encoder 114 on its three output 
25 leads (reading from top to bottom In PIG. 6) iden- 
tifies the supersymbol labeled 110 in RG. 4, and 
so forth for each of the seven other possible bit 
patterns. Additionally, the 3-bit output of encoder 
115 selects a particular symbol within the Identified 
so supersymbol. In particular, the assignment of bit 
values to particular channel symbols within the 
. supersymbols is shown In FIG. 5 for the upper right 
quadrant of the FIG. 4 constellation. The bit assign- 
ment scheme for the other three quadrants are 
35 anivod at by simply rotating FIG. 5. Thus, for 
example, the bit values "001 " output by encoder 
115 on Its three output leads (reading from top to 
bottom) identifies the channel symbol labeled 001 
in the identified supersymboMhere being one such 
40 symbol in each supersymbol. 

Given the use of the particular trellis code 
implemented by the encoder of FIG. 6, various 
operational parameter tradeoffs can be achieved by 
varying the values erf , and <fe. Two possibilities 
45 for the constellation of FIG. 4 are shown in the 
table of FIG. 7. In particular, wiih oVcfe = 2.5. a 
coding gain of 5.7 dB (measured, relative to an 
uncoded 16-QAM scheme such as shown in FIG. 
3-which has the same bandwidth efficiency as the 
so current example-at a block error rate of 10~* for a 
block size of 1.000 bits) Is achieved for tho most 
important bits at a cost of a coding gain of -2.8 dB 
(i.e., a coding loss) for the less important bits. 
Alternatively, with oVcfe « 3.5, a coding gain of 6.6 
55 dB is achieved for the more important bits at a cost 
of a coding gain of -4.G dB for the lose important 
bits. The peak-to-average power ratio is about "2" 
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(as it Is for all the examples described herein), 
which is comparable to that achieved with conven- 
tional uncoded modulation. 

Turning now to the receiver of FIG. 2, the 
analog broadcast signal is received by antenna s 
201, is subjected to conventional television front- 
end processing including, for example, demodula- 
tion in processing unit 21 1, and Is converted to 
digital form by A/D converter 212. The signal Is 
then equalized by passband channel equalizer 221 io 
and passed on parallel rails 222 and 223 to chan- 
nel decoders 231 and 232. Each of the channel 
decoders Is. illustratively, a maximum likelihood 
decoder, such as a Viterbl decoder. Specifically, 
the function of channel decoder 231 is to Identify is 
the most likely sequence of supersymbols, while 
the function of channel decoder 232 is to Identify 
the most likely sequence of symbols, given that 
sequence of supersymbols. Thus, decoder 231 hss 
stored within It information about the code used by 20 
channel encoder' 114, while decoder 232 has 
stored within it information about the code used by 
channel encoder 115. Additionally, between the two 
of them these two decoders have stored within 
them information about the constellation being 25 
used and the manner in which the symbols are 
assigned to their respective supersymbols. 

In channel decoder 231 , the first step of decod- 
ing is to find the supersymbol or half supersymbol 
in each subset that Is closest to the received so 
symbol-such as the point denoted "A" in FIGS. 4 
and 5. In this case, It will be remembered, there is 
only one supersymbol per subset. Channel de- 
coder 231 assumes a specific single location in the 
signal space for each supersymbol or half super- ss 
symbol. Three such locations, denotod with a 
dashed *x", are shown in FIG. 4. The other loca- 
tions are placed similarly. The distance between 
that supersymbol or half supersymbol and the re- 
ceived symbol, Is then determined. (The distance 40 
between the receivod symbol and a supersymbol 
or half supersymbol Is the distance between the 
former and the previousiy defined location of the 
latter.) After this, decoding proceeds to find the 
most likely sequence of transmitted supersymbols <s 
in just the same way that a Viterbl decoder op- 
erates In a conventional coded modulation system 
to find the most likely sequence of conventional 
symbols. 

The operation of channel decoder 232 will be so 
explained with reference to FIG. 5. The first step is 
to rotate the received symbol by an Integral mul- 
tiple of 90 degrees so that the resulting symbol Is 
always in. say. the so-called first quadrant wWch is 
the quadrant depicted In FIG. 5. It is then deter- 00 
mined whether the rotated symbol is closer to 
supGrsymbol 000. or one of the first-quadrant 
halves of supersymbols 001 and 101. After this, for 
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each subset of symbols of the suptersymbol or two 
supersymbol halves On this decoding procedure, 
these two supersymbol halves are treated as it 
they belonged to the same supersymbol). the sym- 
bol that Is closest to the rotated symbol is iden- 
tified and the distances between them are cal- 
culated. This information fs thon used by channel 
decoder 232 to Identify-for the purpose of re- 
covering the less Important btts-the most likely 
# sequence of transmitted symbols. Alternatively 
stated, this determination of the most likely se- 
quence of transmitted symbols is used only for 
purposes of extracting the less Important bits. The 
more Important bits are recovered from channel 
decoder 231 as described above. 

An alternative way of realizing decoder 232 Is 
to wait for decoder 231 to form Its decision as to 
the Identity of each supersymbol and then use this 
information in the recovery of the less important 
bits. (No rotation would be required In this case.) 
Such an approach has the potential advantage of 
aJlowIng one to use a more complex code for the 
less important, bits—and thereby achieve greater 
noise immunity for them-but at a cost of increased 
receiver processing delay. 

Decoding In the case where multi-dimensional 
symbols are used-such as the four-dimensional 
examples described below-is carried out in a simi- 
lar manner, as will be appreciated by those skilled 
in the art 

The bits output by decoders 231 and 232 are 
descrambled by descramblers 241 and 242, which 
respectively perform the Inverse function of scram- 
blers 110 and 111 In the transmitter. A video signal 
formatted so as to be dlsplayable by. for example, 
a CRT display Is then generated from the descram- 
bier outputs by source decoder 253, thereby re- 
covering the original video Information, or Intel- 
ligence. That signal is then applied to CRT display 
260. 

Numerous variations of the invention are possi- 
ble. Consider, tor example, the^ two-dimensional 
constellation of FIG. 8, which is comprised of four 
supersymbols each being comprised, in turn, of 
eight symbols. This constellation could be used in 
a system having m = 1, k * 2— I.e., the bandwidth 
efficiency Is three information bits per signaling 
interval and the most important bits constitute 
333% of the total-and In which each channel 
encoder introduces one redundant bit, I.e., r = 2 ) 
and p = 3. However. In order to increase the 
bandwidth efficiency, this same constellation oan 
be used as the basis of a four-dimensional code 
which supports four Information bits per signaling 
Interval. 

Specifically, the four-dimensional constellation 
is constructed by concatenating the constellation of 
FIG. 8 with Itself so that each four-dimensional 
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symbol is comprised of a first point selected from 
tho two-dimensional constellation concatenated 
with a second such point. (We herein use the word 
"point" to refer to am element of tho two-dimen- 
sionaJ constellation of FIG. 8, thereby differentiating o 
it from the overall coded entity, which we consis- 
tently refer to heroin as a "symbol," no matter what 
its dimensionality. Wo will use the term 
"superpoint" in a similar way.) For this four-dimen- 
sional case, m » 3, k = 5 information bits are to 
input to channel encoders 114 and 115, respec- 
tively, for oach symbol Interval of duration 2T. This 
provides an average of four information bits per 
signaling interval (or eight information bits per sym- 
bol interval). The more; important bits in this case is 
constitute 3/(3 + 5) « 3/8 = 37.5% of the informa- 
tion bits. 

FIG. 9 shows the structure of channel encoders 
114 and 115 for this four-dimensional embodiment 
Encoder 1 1 4 adds, a single redundant bit to its 3-bit 20 
input to provide a pair of 2-bit outputs which re- 
spectively identify first and second superpoints 
from FIG. 8. The first point of the four-dimensional 
symbol to be transmitted is to be selected from the 
first such superpoint and the'second point of the 2s 
four-dimensional symbol to be transmitted is to be 
selected from the second such superpoint. 

The less important bits are used to provide 
such selection. Specifically, encoder 115 adds a 
single redundant bit to the 5-bit input on lead 113 30 
to provide two 3-bit outputs which, as just noted, 
respectively select specific points from the first and 
second superpoints identified by encoder 114. 

Specific circuitry for carrying out the actual 
encoding within channel encoders 114 and 115 is ss 
shown in FIG. 10, the bit converter of which op- 
erates in accordance with the table of FIG. 11. 

The relative performances achieved for this 
embodiment with various values of aVcfe are shown 
in FIG. 7. Note that If one Is willing to have the <o 
most important bits constitute a lower percentage 
of the total-37.5% in this embodiment compared 
to 50% for the first embodlment-a greater coding 
gain can be achieved for such bits. 

A further characteristic of coded modulation «a 
schemes based on FIG. 8-which Is Independent of 
the dimensionality of the overall code-Is that it 
allows for the use of coded modulation schemes 
which ere expected to provide greater Immunity 
against Impulse noise for the most important bits so 
than other constellations, such as that shown in 
FIG. 4 and FIG. 12 (the latter being described 
below). The reason is that the positions of the 
various superpoints relative to one another can be 
defined based solely on angular, as opposed to ss 
amplitude. Information. * 
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A further protection against impulse noise for 
the most Important bits In coded modulation 
schemes based on constellations of the type of 
FIG. 8 can be achieved by rearranging the bits that 
are output by channel encoder 114 so that bits that 
are generated in proximity to one another by the 
encoder are separated from one another as much 
as possible, given that the system delay con- 
straints are met. To this end, channel encoder 114 
may include a bit interleaver, which performs such 
rearrangment, as shown In FIG. 15. (In the receiver, 
a complementary de-tnterleaver will, of course, be 
used-before channel decoder 231.) On the one 
hand, it can be shown that for coded modulation 
schemes in which the Euclidean distance between 
valid sequences of supersymbols is the same (with 
the possible exception of a scaling factor) as the 
Hamming distance betweeen the sequences of bits 
associated with those sequences of supersymbols- 
-which is the case tor the coded modulation 
scheme just described-such rearrangement of the 
bits does not degrade the performance of the code 
against additive white Gaussian noise. On the other 
hand, however, such rearrangement provides an 
enhanced immunity against impulse noise. This Is 
a result of the bursty nature of impulse noise. 
(Enhanced impulse noise immunity can also be 
achieved for coded modulation schemes which do 
not meet the above criteria-such as the various 
other schemes disclosed herein-by rearranging the 
two-dimensional signal points before transmitting 
them. This approach Is somewhat less effective, 
however, than when the bits are rearranged.) 

As another alternative, consider, for example, 
the two-dimensional constellation of FIG. 12, which 
Is comprised of eight supersymbols each being 
comprised, in turn, of four symbols. This constella- 
tion could be used in a two-dimensional signaling 
scheme having m » 2, k « 1-i.e., the bandwidth 
efficiency is three information bits per signaling 
interval and the more important bits constitute 
66.7% of the total-and in which each channel 
encoder introduces one redundant bit. I.e., r = 3 
and p = 2. As before, however, In order to in- 
crease the bandwidth efficiency, this same con- 
stellation can be used as the basis of a four- 
dimensional code. Here we would have m = 5 and 
k 3 for an average of four information bits per 
signaling Interval. The more important bits In this 
case constitute 5/8 = 62.5% of the information 
bits. It will be appreciated that this embodiment is 
similar to that previously described except that tho 
channel encoders for the most- and less-important 
bits are exchanged. Finally, it may be noted from 
FIG. 7 that the increased percentage of most im- 
portant bits brings with it a decreased coding gain 
for those bits. 
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It is also important to note that the constella- 
tions used to Implement the invention need not 
have orthogonally aligned points, as is the caso for 
all of the constellations described thus far. For 
example, the constellation of FIG. 14 has radially- s 
aligned points. There are eight supersymbols each 
of which Is comprised of eight symbols. This con- 
stellation can thus support a two-dimensional cod- 
ed modulation scheme with m = 2, k = 2. Each of 
the supersymbols can be identified based solely on io 
angular Information. Therefore, this constellation, 
like that of FIG. 8. allows for the use of coded 
modulation schemes which are expected to provide 
greater immunity against impulse noise for the 
more Important bits than other constellations. is 

The foregoing merely Illustrates the principles 
of the Invention. For example, it is assumed in FIG. 
1 that only one broadcast signal polarization is 
used. However, ft is possible to double the band- 
width efficiency of the scheme by using a second 20 
set of coding circuitry to encode a second source- 
coded data stream in parallel with tho first and to 
transmit the resulting coded modulated signal us- 
ing a second polarization. Alternatively, a single 
data coding rail can be employed but Its speed can 25 
be doubled by transmitting alternate signal points 
on the two polarizations. 

It should be noted that, although in all the 
examples shown herein, the less Important bits are 
always coded, this Is not necessary. That is, un- so 
coded bits can be used to select a symbol from 
the identified supersymbol. It should also be noted 
that, although in all of the examples shown herein, 
tho minimum distance between superpoints Is 
always greater than the minimum distance 02 be- ss 
twecn points, this Is not necessary. For example. 
0*1 can be equal to <h In FIG. 8. It should also be 
noted that, although in all the examples shown 
herein, only two classos of data elements are ac- 
commodated, the Invention is not so limited. As 40 
many classes of data elements 6s desired can, in 
fact, be accommodated by dividing the class of 
loss important bits into two or more subclasses and 
applying the principles of the invention to the cod- 
ing of those subclasses in straightforward fashion. 45 
Moreover, although all the examples shown herein 
code either throe or four information bits at a time, 
the Invention is not In any way limited to these. 

In the examples shown herein, encoders 114 
and 115 are always of the same dimensionality. « 
However, this is not necessary. For example, a 
two-dimensional code could be used for the more 
Important data elements to identify a sequence of 
superpoints of a predetermined two-dimensional 
constellation. A four-dimensional code could then « 
be used for the less Important data elements to 
select points from sequential pairs of superpoints 
from that sequence. Conversely, a four-dlmenslonal 



code could be used for the more important data 
elements and a two-dimensional code for the less 
important data elements. 

In the examples shown herein, encoders 114 
and 115 always implement B-state trellis codes. 
However, this is not necessary. Codes having other 
than 6 states are equally usable. Moreover, other 
types of codes, such as block codes, can be used 
instead of trellis codes. 

In some applications, it may be desired to 
provide for the possibility of phase rotations in the 
received signal caused by channel disturbance. In 
such applications,' differential encoding circuitry 
may be included within channel encoder 114 to 
take care of this problem. 

In addition, the invention is Illustrated herein in 
the context of a digital video transmission system. 
However, It is equally applicable to other types of 
digital transmission systems. Moreover, although 
particular constellations are shown herein, numer- 
ous other constellations, which may be of any 
desired dimensionality, can be used. 

it may also be noted that although the Inven- 
tion is illustrated herein as being implemented with 
discrete functional building blocks, e.g., source 
coders, scramblers, etc., the functions of any one 
or more of those building blocks can be carried out 
using one or more appropriate programmed pro- 
cessors, digital signal processing (DSP) ohips, etc. 
Thus although each of the various "means" recited 
in the claims hereof may correspond. In some 
embodiments, to specific circuitry which is specifi- 
cally designed to perform the function of just that 
means, It will be appreciated thaj such "means'* 
may alternatively ' correspond, In other embodi- 
ments, to the combination of processor-based cir- 
cuitry combined with stored program instructions 
which cause that circuitry to perform the function in 
question. 

It win thus be appreciated that those skilled in 
the art will bo able to devise numerous and various 
alternative arrangements which, although not ex- 
plicitly shown or described herein, embody the 
principles of the invention and are within its spirit 
and scope. 

Claims 

1. A method 

CHARACTERIZED BY the steps of 
encoding a first group of data elements to 
generate a first expanded group of data ele- 
ments. . \ 

Identifying one of a plurality of supersym- 
bols of a predetermined channel symbol con- 
stellation In response to the first expanded 
group of data elements, each supersymbol be- 
ing comprised of a respective plurality of sym- 
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bois of the constellation, 

selecting an Individual one of the symbols 
of the Identified supersymbol at least in re- 
sponse to a second group of data elements, 
and 5 

applying to a communication channel a 
signal representing the selected symbol, 

the minimum distance between at least 
ones of the symbols of at least one of the 
supersymbols being the same as the minimum to 
distance betweeen the symbols of the con- 
stellation as a whole. 



2. The Invention of claim 1 

CHARACTERISED IN THAT , 6 
the selecting step includes the steps of 
encoding said second group of data ele- 
ments to generate a second expanded group 
of data elements, and 

selecting said individual symbol in re- 20 
sponse to the second expanded group of data 
elements. 



8. A method for use in a receiver which receives 
intelligence communicated to said receiver by 
a transmitter, said transmitter being adapted to 
channel code successive groups of m*k data 
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3. The invention of claim 1 

CHARACTERIZED IN THAT 
said encoding step includes the step of 
trellis coding said first group of data elements. 

4. The invention of claim 1 

CHARACTERIZED BY 30 
the further step of generating said data 
elements by source coding input information In 
such away that said first group of data ele- 
ments represents a portion of said information 
that is more important than the portion of said as 
Information represented by said second group 
of data elements, 

5. The invention of claim 4 

CHARACTERIZED IN THAT «, 
said information is television Information. 

6. The invention of claim 1 

CHARACTERIZED BY 

the further step of rearranging the first 45 
expanded group of data elements prior to said 
identifying step. 

7. The invention of claim 1 

CHARACTERIZED IN THAT 50 
at least one of said supersymbols is com- 
prised of at least two non-contiguous groups of 
symbols. 
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bits associated with respective symbol inter- 
vals via the steps, performed for each said 
Interval, of a) encoding m of the bits of one of 
the groups using a first predetermined code to 
generate an expanded group of r bits, r > m; 
b) Identifying a particular one of 2* supersym- 
bols of a predetermined channel symbol con- 
stellation as a function of the values of said r 
bits, each of said supersymbols being com- 
prised of a plurality of symbols of said con- 
stellation assigned thereto and the minimum 
distance between the symbols of each super- 
symbol being the same as the minimum dis- 
tance between the symbols of the constellation 
as a whole; c) generating a signal representing . 
a selected one of the channel symbols of the 
identified one supersymbol, the selection being 
performed as a function of the values of the 
other k bits of said one group; and d) commu- 
nicating said signal to said receiver over a 
communication channel; 

said method CHARACTERIZED BY the 
steps of 

receiving said signal from said channel, 

and 

recovering said intelligence from the re- 
ceived signal, said recovering being carried out 
in response to information stored in said re- 
ceiver about said first predetermined code, 
about said constellation, and the manner In 
which said symbols are assigned to their re- 
spective supersymbols. 

9. The Invention of claim 8 

CHARACTERIZED IN THAT 

the signal generating step in the transmit- 
ter Includes the steps of a) encoding the other 
k bits of said one of the groups using a second 
predetermined code to generate a second ex- 
panded group of p bits, p > k; and b) selecting 
said individual symbol In response to the sec- 
ond expanded group of data bits, 

and FURTHER CHARACTERIZED IN 
THAT 

said recovering step is carried out further 
In response to Information stored in said re- 
ceiver about said second predetermined code. 

10. The invention of claim 3 

CHARACTERIZED IN THAT 

said intelligence is television information. 

11- The invention of claim 10 

CHARACTERIZED IN THAT 

said recovering step includes the step of 
decoding the received signal to recover said 
successive groups of data bits using maximum 
likelihood decoding. 
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12. Apparatus operative during each of a success- 
ion of symbol Intervals for channel coding 
respective groups of m + k data bits, said ap- 
paratus 

CHARACTERIZED BY 5 

means for encoding m of the bits of one of 
the groups to generate an expanded group of r 
bits, r > m, 

means for identifying a particular one of 2' 
supcrsymbols of a predetermined channel to 
symbol constellation as a function of the val- 
ues of said r bits, each of said supersymbols 
being comprised of a plurality of symbols of 
said constellation, and 

means for generating a signal representing rs 
a selected one of the channel symbols of the 
identified one supersymbol, the selection being 
performed as a function of the values of the 
other k bits of said one group, 

the minimum distance between the sym- 20 
bols of each supersymbol being the same as 
the minimum distance between the symbols of 
the constellation as a whole. 

13. The Invention of claim 12 25 

CHARACTERIZED IN THAT 
said data bits represent television informa- 
tion. 

14. The invention of claim 13 ao 

FURTHER CHARACTERIZED BY 
means for generating said data bits by 
source coding input information in such a way 
that said m bits represent a portion of said 
information that is more Important than the 35 
portion of said Information represented by said 
kbits. 

15. The invention of claim 14 

CHARACTERIZED IN THAT <o 

said generating means Includes 

means for encoding the other k bits of said 
one of the groups to generate an expanded 
group of p bits, p > k, and 

means for selecting said individual symbol <s 
in response to said expanded group of p bits. 

16. The invention of claim 15 

CHARACTERIZED IN THAT 

said m-bit and k-bit encoding means In- 50 
elude means for trellis coding said m and k 
bits, respectively. 

17. The Invention of claim 15 

CHARACTERIZED IN THAT 55 
at least ones of said supersymbols are 

• each comprised of at least two non-contiguous 

groups of symbols. 

10 
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18. The Invention of claim 16 

FURTHER CHARACTERIZED BY 
means for rearranging said expanded 
group of r bits prior to said Identifying step. 

19. An arrangement for use In a receiver which 
receives Intelligence communicated to said re- 
ceiver by a transmitter, said transmitter includ- 
ing apparatus for a) encoding a first stream of 
the data elements using a first predetermined 
code to generate a first expanded stream of 
data elements; b) Identifying a sequence of 
supersymbols' of a predetermined channel 
symbol constellation In response to the first 
expanded stream of data elements, the mini- 
mum distance between at least ones of the 
symbols of at least one of the supersymbols 
being the same as the minimum distance be- 
tweeen the symbols of the constellation as a 
whole; c) encoding a second stream of data 
elements using a second predetermined code 
to generate a second expanded stream of data 
elements; d) selecting an Individual one of the 
symbols of each supersymbol of said se- 
quence at least as a function of the second 
expanded stream of data etements: and d) 
means for applying to a communication chan- 
nel a signal representing the selected symbols. 

said arrangement CHARACTERIZED BY 
means for receiving the signal from the 
communication channel, and 

means for carrying* out a maximum likeli- 
hood decoding operation on the received sig- 
nal to recover said first stream of data ele- 
ments and for carrying out a second maximum 
likelihood decoding operation on the received 
signal to recover said second stream of data 
elements. 

20. The Invention of claim 19 

CHARACTERIZED IN THAT 
said first and second codes are trellis 
codes. 

21. The Invention of claim 19 

CHARACTERIZED IN THAT 

said Intelligence Is television Information. 
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